Display device and method for providing content using the same

ABSTRACT

A display device and a method for providing content using the display device are disclosed. A controller receives a search term and searches for at least one content including a video frame associated with the received search term. A display displays a list of the searched content.

This application claims the benefit of Korean Patent Application No.10-2011-0121114, filed on Nov. 18, 2011, which is hereby incorporated byreference as if fully set forth herein.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a display device and a method forproviding content using the same and more particularly, to a displaydevice and a method for providing content using the same which canreceive, store, edit and reproduce content.

2. Discussion of the Related Art

Display devices have, for example, a function for receiving andprocessing a broadcast image viewable by a user. Such a display devicemay display a broadcast, which is selected by the user from amongbroadcast signals transmitted from a broadcast station, on a display.Currently broadcasters are transitioning from analog broadcasting todigital broadcasting.

Digital broadcasting refers to broadcasting of transmitting digitalaudio and video signals. Digital broadcasting has low data loss due torobustness against external noise, favorable error correction, highresolution and high-definition screen, as compared with analogbroadcasting. In addition, digital broadcasting may provide abidirectional service unlike analog broadcasting.

To enable utilization of digital broadcasting, multimedia devices havebeen developed to have higher performance and a greater number offunctions than conventional multimedia devices and in turn, servicesavailable to the multimedia devices have been diversified into Internetservices, Video On Demand (VOD), electronic album services, and thelike.

Conventional display devices provide content retrieval based only oncharacter information and therefore, retrieval of a video frame relatedto desired content requires a user to directly see and hear reproducedvideo and audio content.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a display device and amethod for providing content using the same that substantially obviateone or more problems due to limitations and disadvantages of the relatedart.

One object of the present invention is to provide a display device and amethod for providing content using the same which can search for a videoframe and audio contained in content.

Another object of the present invention is to provide a display deviceand a method for providing content using the same which can search for avideo frame and audio contained in content that is stored in anotherdevice.

A further object of the present invention is to provide a display deviceand a method for providing content using the same which provide a userinterface to assist in easily checking search results of a searchedvideo frame and audio and easily selecting and editing the searchedvideo frame and audio.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amethod for providing content using a display device, includes receivinga user input, searching for at least one content including a video frameassociated with a search term included in the received user input, anddisplaying a list of the searched content.

The method may further include editing content included in the list ofthe searched content. The editing may include at least one of thefollowing steps, replacing a video frame of the content with anothervideo frame, dubbing voice to the content, varying a voice level of atleast a part of audio data included in the content, and replacing atleast a part of audio data included in the content with previouslystored audio data.

The content may be stored in at least one of a global resource and alocal resource.

The displayed list may include a thumbnail with respect to the videoframe.

The method may further include detecting a user action of selecting thethumbnail, and displaying a video frame associated with the selectedthumbnail.

The method may further include detecting a user action of selectingcontent included in the list, and displaying a thumbnail of a videoframe associated with the search term among video frames included in thecontent.

The searching for the content may include searching for the vide frameassociated with the search term using a content information databaseincluding image information with respect to the video frame included inthe content.

The method may further include constructing the content informationdatabase.

The constructing may include accessing content, extracting a video frameincluded in the accessed content, checking whether or not the extractedvideo frame satisfies requirements of a key frame, selecting the videoframe as the key frame if the video frame satisfies the requirements ofthe key frame, and producing image information associated with theselected video frame.

The producing image information may include producing image informationusing information included in a visual descriptor of the content.

The content information database may further include positioninformation of the video frame and information to associate the positioninformation of the video frame with the image information.

The image information may include at least one of characteristicsinformation on the video frame, subjective information on the videoframe and expository information on the video frame.

In accordance with another aspect, a display device includes acontroller to receive a search term and search for at least one contentincluding a video frame associated with the received search term, and adisplay to display a list of the searched content.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a view illustrating the configuration of a multimedia systemin accordance with an exemplary embodiment of the present invention.

FIG. 2 is a block diagram illustrating the configuration of a displaydevice in accordance with an exemplary embodiment of the presentinvention.

FIG. 3 is a flowchart illustrating the implementation procedure of amethod for constructing a content information database in accordancewith an exemplary embodiment of the present invention.

FIG. 4 is a flowchart illustrating the implementation procedure of amethod for analyzing information on a video frame in accordance with anexemplary embodiment of the present invention.

FIG. 5 is a view illustrating an exemplary embodiment of a video frame.

FIG. 6 is a view illustrating another exemplary embodiment of a videoframe.

FIG. 7 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with an exemplary embodimentof the present invention.

FIG. 8 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to input a search term is displayed.

FIG. 9 is a view illustrating an exemplary embodiment of a screen onwhich search results are displayed.

FIG. 10 is a view illustrating an exemplary embodiment of a screen onwhich thumbnails are displayed.

FIG. 11 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with an exemplary embodimentof the present invention.

FIG. 12 is a view illustrating an exemplary embodiment of a screen onwhich an object selecting mark is displayed.

FIG. 13 is a view illustrating another exemplary embodiment of a screenon which thumbnails are displayed.

FIG. 14 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with another embodiment ofthe present invention.

FIG. 15 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with a further embodiment ofthe present invention.

FIG. 16 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to select the voice tone of an object is displayed.

FIG. 17 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to select an entertainer is displayed.

FIG. 18 is a block diagram illustrating the configuration of acontroller in accordance with an exemplary embodiment of the presentinvention.

FIG. 19 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to set a voice modulation level is displayed.

DETAILED DESCRIPTION OF THE INVENTION

Exemplary embodiments of the present invention that can embody the abovedescribed objects will be described with reference to the attacheddrawings. Here, it should be understood that configurations andoperations of the present invention that are illustrated in the drawingsand explained in conjunction with the illustration are merely describedas at least one embodiment and the technical ideas and essentialconfigurations and operations of the present invention are not limitedby the description.

Although the terms used in the present invention are selected fromgenerally known and used terms in consideration of functions thereof inthe present invention, these terms may vary according to intentions ofthose who skilled in the art, usual practice or advent of noveltechnologies. Furthermore, the terms may be selected at the discretionof the applicant in special cases and in this case, the detailedmeanings of these terms are described in relevant parts of thedescription herein. Accordingly, the terms used herein should beunderstood not simply by the actual terms used but by the meaning lyingwithin and the description disclosed herein.

FIG. 1 is a view illustrating the configuration of a multimedia systemin accordance with an exemplary embodiment of the present invention.

Referring to FIG. 1, the multimedia system 100 in accordance with thepresent invention may include a display device 110, external resources112, 114, 120, 130 and 140, and a repeater 150. The external resources112, 114, 120, 130 and 140 may be divided into a global resource 140 andlocal resources 112, 114, 120 and 130.

The global resource 140 is a server located on a Wide Area Network(WAN). The global resource 140 may provide the display device 110 withan Internet service and a broadcast service. The internet service refersto a service provided via the Internet, such as a Content on Demand(CoD) service, a YouTube service, an information service for providingweather, news and local information and enabling information retrievaland the like, an entertainment service related to gaming, singing andthe like, and a communication service related to TV mail and TV ShortMessage Service (SMS) services and the like. The broadcast service mayinclude an IPTV broadcast service.

Of the local resources 112, 114, 120 and 130, information communicationappliances 120 and 130 are provided with a memory and may implement anetwork function, examples of which may include a Home server, a PC, alaptop computer, a cellular phone and a Personal Digital Assistant(PDA), and the like. Also, external storage media, including a USBexternal hard disc 112 and a USB flash memory 114, is connected to thedisplay device 110 via a serial bus interface. In one example, aplurality of components including the display device 110 and theexternal resources 112, 114, 120, 130 and 140 may be provided toconstitute a single home network. The local resources 120 and 130 may bereplaced by the display devices 110.

The multimedia system 100 in accordance with the present inventionfurther includes a remote controller 111, which can send and receivedata to or from the display device 110 in a wired or wireless manner. Auser may control the display device 110 via the remote controller 111 ina wired or wireless manner.

The display device 110 may be directly connected to the local resources120 and 130 in a wired or wireless manner according to standard protocolcommunication, or may be connected to the local resources 120 and 130via the repeater 150. The repeater 150 serves to relay datasending/reception between the display device 110 and the local resources120 and 130. The display device 110 may adopt standard protocolcommunication, such as IEEE802.11, IEEE802.11n, IEEE802.11g,IEEE802.15.4, WiFi, Ethernet, WCDMA, GRS, and the like. The displaydevice 110 may receive content from the local resources 120 and 130using Digital Living Network Alliance (DLNA) and may display thereceived content.

The display device 110 may receive an Internet service and a broadcastservice from the global resource 140. In one example, the display device110 may receive streaming data including content data from the globalresource 140 and may display the content data included in the receivedstreaming data.

FIG. 2 is a block diagram illustrating the configuration of a displaydevice in accordance with an exemplary embodiment of the presentinvention.

Referring to FIG. 2, the display device 110 in accordance with thepresent invention may include a receiver 201, a demultiplexer 240, avideo decoder 244, an audio decoder 248, a display 250, an audio outputunit 260, an input unit 270, a storage unit 280 and a controller 290. Insome embodiments, the display device 110 may include an image captureunit 295.

The receiver 201 may receive broadcast data, video data, audio data,information data, and applications. The receiver 201 may include a tuner210, a demodulator 220, a mobile communication unit 215, a networkinterface 230, a voice sensing unit 233 and an external signal receiver235. The tuner 210 may receive applications via a broadcast network, andthe mobile communication unit 215 may receive applications via a mobilecommunication network, such as 2G, 3G and 4 G communication networks,etc. The network interface 230 may receive applications and content fromthe global resource 140 and the local resources 120 and 130, and theexternal signal receiver 235 may receive applications and content fromthe local resources 112, 114, 120 and 130.

The demultiplexer 240 serves to demultiplex a stream signal output fromthe demodulator 220 into video and audio signals. Additionally, thedemultiplexer 240 may receive video data, audio data, broadcast data,information data and application data from the mobile communication unit215, the network interface 230 and the external signal receiver 235.

The video decoder 244 implements decoding the demultiplexed video signalfrom the demultiplexer 240 and outputs a decoded video signal to thedisplay 250.

The audio decoder 248 implements decoding the multiplexed audio signalfrom the demultiplexer 240 and outputs a decoded audio signal to theaudio output unit 260.

The display 250 serves to display the image 252. The display 250 may beoperated in connection with the controller 290. The display 250 maydisplay a Graphical User Interface (GUI) 253, which provides aninterface for allowing the user to easily access an operating system(OS) of the display device or an application that is being executed onthe operating system.

The audio output unit 260 may receive audio data from the audio decoder248 and the controller 290 and output the sound 261 via reproduction ofthe received audio data. In some embodiments, the sound 261 may bevoice, the tone of which is modulated according to a voice tone settingvalue. In some embodiments, the sound 261 may be sound sensed by thevoice sensing unit 233 during display of the image 252, other than soundof an audio signal decoded by the audio decoder 248.

The input unit 270 may be a touch screen which is arranged on thedisplay 250 or at the front of the display 250, or may be acommunication unit which receives a signal from a remote controller. Theinput unit 270 may receive a remote controller transmission signal fromthe remote controller 111.

In some embodiments, the receiver 201 may be a communication unit toreceive a signal from the remote controller 111. Specifically, theexternal signal receiver 235 may receive the remote controllertransmission signal from the remote controller 111. The remotecontroller transmission signal may contain content data, and the displaydevice 110 in accordance with the present invention may receive contentcontained in the remote controller transmission signal.

The storage unit 280 generally provides a location where program codeand data to be used by the display device 110 are stored. The programcode may be program code of an application that the receiver 201receives and program code of an application previously stored uponmanufacture of the display device 110. The application may be programmedin programming languages, such as HTML, XML, HTML5, CSS, CSS3,JavaScript, Java, C, C++, Visual C++, c#, etc.

The storage unit 280 may store a content information database and avoice tone setting value. The content information database may storecontent identifiers to identify content, content position information toindicate an address where content is stored, content image informationand information to associate the position information with the imageinformation. The image information may include a thumbnail with respectto a scene included in an image, information on a position of a scene,objective and subjective information on a scene and expositoryinformation on a scene. The scene may be organized by a single videoframe or one or more video frames, and the objective information on thescene may refer to characteristic information on the scene.

The storage unit 280 may be implemented as a Read-Only Memory (ROM), aRandom Access Memory (RAM), a hard disk drive, or the like. The programcode and data may be stored in a separable storage medium and may beloaded or installed onto the display device 110 as necessary. Theseparable storage medium may include a CD-ROM, a PC-CARD, a memory card,a floppy disk, a magnetic tape and a network component.

The controller 290 serves to execute an instruction and implement anoperation associated with the display device 110. For example, thecontroller 290 may control reception and processing of input and outputbetween components of the display device 110 and data reception andprocessing, using an instruction searched from the storage unit 280.

The controller 290 further serves to execute program code together withan operating system and to produce and use data. The operating system isgenerally known and therefore, a detailed description thereof isomitted. An example of the operating system may include Windows OS,Unix, Linux, Palm OS, DOS, Android, and Mac OS. The operating system,other computer code and data may be present within the storage unit 280which is operated in connection with the controller 290.

The controller 290 may be implemented on a single chip, a plurality ofchips, or a plurality of electric components. For example, a variety ofarchitectures, including a dedicated or embedded processor, a singlepurpose processor, a controller, an Application Specific IntegratedCircuit (ASIC), etc., may be used with respect to the controller 290.

The controller 290 may recognize a user action and may control thedisplay device 110 based on the recognized user action. The user actionmay include selection of a physical button on the display device or theremote controller, execution of a prescribed gesture or selection of asoft button on a touch screen display, execution of a prescribed gesturerecognized from an image captured through an image capture unit, andproduction of prescribed sound recognized by sound recognition. Thegesture may include a touch gesture and a spatial gesture.

The input unit 270 receives a gesture 271, and the controller 290executes instructions to implement operations associated with thegesture 271. Additionally, the storage unit 280 may contain a gestureoperating program 281, which may be a part of an operating system or aseparate application. The gesture operating program 281 generallycontains a series of instructions for recognizing occurrence of thegesture 271 and informing one or more software agents of the gesture 271and/or which actions should be taken in response to the gesture 271.

FIG. 3 is a flowchart illustrating the implementation procedure of amethod for constructing a content information database in accordancewith an exemplary embodiment of the present invention.

Referring to FIG. 3, the controller 290 controls access to content(S100). The content may be stored in the storage unit 290 and theexternal resources 112, 114, 120, 130 and 140. The content may betransmitted from the global resource 140 by streaming. Operation S100may be automatically implemented after booting, may be periodicallyimplemented, or may be implemented upon user request. Additionally,operation S100 may be automatically implemented when content data istransmitted from the global resource 140 by streaming.

The controller 290 extracts a video frame contained in the accessedcontent (S110). The controller 290 may extract I-frame, B-frame and evenP-frame.

The controller 290 analyzes space-time information on the extractedvideo frame (S120). The controller 290 may analyze space-timeinformation on the video frame using information contained in a visualdescriptor that is defined by Moving Picture Experts Group (MPEG) 7.

The controller 290 checks whether or not the extracted video framesatisfies requirements of a key frame (S130). The requirements of thekey frame may include a requirement that the key frame correspond to avideo frame of a portion where scene change occurs. That is to say, thecontroller 290 may check whether or not an extracted video frame is avideo frame of a portion where scene change occurs. In some embodiments,the controller 290 may check whether or not a video frame is a videoframe of a portion where scene change occurred using space-timeinformation on the video frame analyzed in operation S120. In someembodiments, the controller 290 may calculate a change rate by comparinga current video frame with a previous video frame and may select a videoframe 500 as a key frame if the calculated change rate is 50% or more.

If a video frame satisfies the requirements of a key frame, thecontroller 290 selects the video frame as the key frame (S140).

The controller 290 analyzes information on the video frame that isselected as the key frame (S150). The controller 290 may analyzeinformation on the video frame using information contained in a visualdescriptor that is defined by MPEG 7. The analyzed information may beimage information. In some embodiments, operation S150 may include theimplementation procedure of a method for analyzing information on avideo frame of FIG. 4.

The controller 290 stores the information analyzed in operation S150(S160). The information may be stored in the storage unit 280, and maybe stored in the external resources 112, 114, 120, 130 and 140.Additionally, the information may be included in the content informationdatabase. The controller 290 may store information on content accessedin operation S100, such as content identifiers, content positioninformation and information to associate the content identifiers withthe content position information.

The content information database may index and store the informationthat is analyzed on a per key frame basis in operation 150. In someembodiments, the information analyzed in operation S150 may be indexedand stored based on characters as an index key, the characters being oneof information included in the analyzed information of operation 150.

FIG. 4 is a flowchart illustrating the implementation procedure of amethod for analyzing information on a video frame in accordance with anexemplary embodiment of the present invention.

Referring to FIG. 4, the controller 290 analyzes objective informationon a key frame (S200). The objective information includes characteristicvalues with respect to the key frame based on color, shape and pattern.In operation S200, the controller 200 extracts the characteristic valuesfrom the key frame.

The controller 290 analyzes subjective information on the key frame(S210). The subjective information is information to indicate happiness,sadness, anger, love, etc. In operation S210, the controller 290determines the subjective information represented by the key frame.

The controller 290 analyzes expository information on the key frame(S220). The expository information includes expository information onevents, actions and comments related to a video frame and information oncharacters included in a video frame. In operation S220, the controller290 detects the expository information on the key frame.

FIG. 5 is a view illustrating an exemplary embodiment of a video frame.

Referring to FIG. 5, the controller 290 may extract a video frame 500from content. Then, the controller 290 may check whether or not thevideo frame 500 is a video frame of a portion where scene change occursand based on the checked results, may select the video frame 500 as akey frame. The controller 290 may calculate a change rate by comparingthe video frame 500 with a previous video frame and may select the videoframe 500 as a key frame if the calculated change rate is 50% or more.

The controller 290 extracts objective information, such ascharacteristic values representing a circular collimator 511, a blackgarment 513 and the like, from the key frame 500. Additionally, thecontroller 290 determines the key frame 500 as indicating sadness basedon subjective information on the key frame 500. The controller 290 mayextract the subjective information from an MPEG 7 visual descriptor.

The controller 290 detects expository information on the key frame 500,such as the name of a character 520 “LEE BYEONGHEON”, action of thecharacter 520 “Shooting” and the name of content containing the keyframe 500 “IRIS”.

FIG. 6 is a view illustrating another exemplary embodiment of a videoframe.

Referring to FIG. 6, the controller 290 may extract a video frame 600from content. Then, the controller 290 may check whether or not thevideo frame 600 is a video frame of a portion where scene change occursand based on the checked results, may select the video frame 600 as akey frame. The controller 290 may calculate a change rate by comparingthe video frame 600 with a previous video frame and may select the videoframe 600 as a key frame if the calculated change rate is 50% or more.

The controller 290 extracts objective information, such ascharacteristic values representing black/white stripes 611 and the like,from the key frame 600. Additionally, the controller 290 determines thekey frame 600 as indicating love based on subjective information on thekey frame 600. The controller 290 may extract the subjective informationfrom an MPEG 7 visual descriptor.

The controller 290 detects expository information on the key frame 600,such as the name of a character 621 “HA GEE WON”, the name of acharacter 623 “HYUN BIN”, action of the character 623 “Sit-ups”, thebackground of the video frame 600 “Gymnasium” and the name of contentcontaining the key frame 600 “SECRET GARDEN”.

FIG. 7 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with an exemplary embodimentof the present invention.

Referring to FIG. 7, the controller 290 constructs a content informationdatabase (S300). Operation S300 may include the implementation procedureof the method for constructing a content information database of FIG. 3.

The controller 290 detects a user action of requesting retrieval (S310).

In response to the detected user action, the controller 290 may controldisplay of a GUI to input a search term (S310). The GUI may be displayedto overlay a broadcast screen, or may be displayed over the entirescreen.

FIG. 8 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to input a search term is displayed.

Referring to FIG. 8, the display 250 may display a screen 800 inoperation S310. The screen 800 includes an image region 810 and a GUIregion 820. The image region 810 displays a currently displayed imageand the GUI region 820 displays a GUI to input a search term.

The GUI region 820 includes a search term input window 821, an imaginarykeypad 823, an ‘OK’ button 825 and a ‘Cancel’ button 827. The user mayinput a search term using the imaginary keypad 823, and the input searchterm is displayed on the search term input window 821. The search terminput window 821 displays a currently input search term “LEEBYEONGHEON”. The user may request retrieval using the search term inputinto the search term input window 821 by pressing the ‘OK’ button 825,and may cause the GUI region 820 to disappear by pressing the ‘Cancel’button 827 without retrieval. Additionally, the user may press buttonsof the imaginary keypad 823, the ‘OK’ button 825 and the ‘Cancel’ button827 using a pointer 830.

The controller 290 checks whether or not the search term is input(S330). In some embodiments, in the case in which the ‘OK’ button 825illustrated in FIG. 8 is pushed, the controller 290 confirms that thesearch term displayed on the search term input window 821 is input.

If the search term is input, the controller 290 searches for contentfrom the content information database that is constructed based on theinput search term (S340). The controller 290 searches for contentincluding a video frame associated with the search term by comparingimage information included in the content information database with theinput search term. That is to say, the controller 290 searches for avideo frame containing image information equal or similar to the inputsearch term.

For example, if the input search term is “LEE BYEONGHEON”, thecontroller 290 may search for image information including “LEEBYEONGHEON” from the content information database and may detect videoframes containing the image information. If the input search term is“scene in IRIS where LEE BYEONGHEON, who wears a black garment, shootswith a sad expression”, the controller 290 may search for imageinformation including the collimator, black garment, sadness, LEEBYEONGHEON, shooting and IRIS from the content information database, andmay detect the video frame 500 of FIG. 5 containing the searched imageinformation. In addition, if the input search term is “scene in SECRETGARDEN where HYUN BIN, who wears black training clothes, is performingsit-ups together with lovely HA GEEWON in a gymnasium”, the controller290 may search for image information including black/white stripes,love, HA GEE WON, HYUN BIN, gymnasium and SECRET GARDEN and may detectthe video frame 600 of FIG. 6 including the searched image information.

The controller 290 displays the search results (S350). The searchresults may be displayed to overlay a broadcast screen, or may bedisplayed over the entire screen.

FIG. 9 is a view illustrating an exemplary embodiment of a screen onwhich search results are displayed.

Referring to FIG. 9, the display 250 may display a screen 900 inoperation S350. The screen 900 includes an image region 910 and a searchresults region 920. The image region 910 displays a currently displayedimage and the search results region 920 displays the search results.

The search results region 920 displays content 930, 940, 950 and 960 andthumbnails 935, 945, 955 and 965 of content, which are searched forbased on the search term. The content 930, 940, 950 and 960 may becontent identifiers (for example, file names or titles). That is to say,‘AAA’ designated by reference numeral 930 may be the file name ofcontent.

The thumbnails 935, 945, 955 and 965 may be thumbnails of video framesassociated with the search term. That is to say, the thumbnails 935,945, 955 and 965 may be produced by reducing the associated videoframes, and may be produced to contain specific objects included in theassociated video frames.

In the case in which a plurality of video frames associated with asearch term is present in single content, the controller 290 may selecta representative video frame among the plurality of video frames and maycontrol display of a thumbnail of the selected representative videoframe in the search results region 920. For example, the ‘AAA’ 930 mayinclude a plurality of video frames associated with the input searchterm of FIG. 8, and the thumbnail 935 may be a thumbnail of a firstlydisplayed video frame among the video frames or a thumbnail of a videoframe having the greatest association with the search term.

The controller 290 checks whether or not a content file is selected(S360). In the case in which specific content among content displayed assearch results is selected, the controller 290 may confirm that acontent file is selected. For example, if ‘BBB’ designated by referencenumeral 940 of FIG. 9 is selected, the controller 290 may confirm that acontent file of ‘BBB’ is selected.

The controller 290 displays a thumbnail of the selected content file(S370). Thumbnails of video frames associated with a search term amongvideo frames included in the selected content file may be displayed.

FIG. 10 is a view illustrating an exemplary embodiment of a screen onwhich thumbnails are displayed.

Referring to FIG. 10, in the case in which the ‘AAA’ 930 of FIG. 9 isselected in operation S360, the display 250 may display a screen 1000 inoperation S370. The screen 1000 includes an image region 1010 and athumbnail region 1020. The image region 1010 displays a currentlydisplayed image, and the thumbnail region 1020 displays thumbnails 1030,1040, 1050 and 1060 and times 1035, 1045, 1055 and 1065 when thethumbnails are displayed. The thumbnails 1030, 1040, 1050 and 1060 maybe thumbnails of video frames associated with a search term among videoframes included in the ‘AAA’ 930. For example, the thumbnail 1040 is athumbnail of a video frame included in the ‘AAA’ 930, which is displayedafter a display time of the ‘AAA’ 930, e.g., 20 minutes has passed.

The controller 290 checks whether or not a thumbnail is selected (S380).The thumbnail may be a thumbnail of the search results displayed inoperation S350 or a thumbnail displayed in operation 370. For example,the controller 290 may confirm that a thumbnail is selected when thethumbnail 935 of FIG. 9 or the thumbnail 1040 of FIG. 10 is selected.

If the thumbnail is selected, the controller 290 controls display of thevideo frame indicated by the selected thumbnail (S390). For example, ifthe thumbnail 935 of FIG. 9 is selected, the controller 290 displays thevideo frame associated with the thumbnail 935. The ‘AAA’ 930 may bedisplayed from the video frame associated with the thumbnail 935.Additionally, if the thumbnail 1040 of FIG. 10 is selected, thecontroller 290 controls display of the video frame associated with thethumbnail 1040. That is to say, the ‘AAA’ 930 may be displayed from thevideo frame associated with the thumbnail 1040.

FIG. 11 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with an exemplary embodimentof the present invention.

Referring to FIG. 11, the controller 290 constructs a contentinformation database (S400). Operation S400 may include theimplementation procedure of the method for constructing a contentinformation database of FIG. 3.

The controller 290 controls display of an image (S410). The image may bean image stored in the storage unit 280, may be an image received fromthe external resources 112, 114, 120, 130 and 140, or may be an imagereceived by the tuner 210.

The controller 290 detects a user action of requesting retrieval (S420).

The controller 290 controls display of an object selecting mark inresponse to the detected user action (S430). The object selecting markmay be used to select an object included in an image displayed inoperation S420. The object may include at least one of human, animal andnatural objects.

FIG. 12 is a view illustrating an exemplary embodiment of a screen onwhich an object selecting mark is displayed.

Referring to FIG. 12, the display 250 displays a screen 1200 inoperation S430. The screen 1200 may include object selecting marks 1210,1220, 1230 and 1240 to select an object included in an image. The usermay select one of the object selecting marks 1210, 1220, 1230 and 1240by locating a pointer 1201 at a region occupied by the correspondingobject selecting mark and pressing a specific button (for example, a‘OK’ button) on a remote controller. Alternatively, the user may selectthe object selecting mark using an indicator 1205.

The controller 290 checks whether or not an object is selected (S440).If one of the displayed object selecting marks is selected in operationS440, the controller 290 confirms that an object indicated by theselected object selecting mark is selected.

If the object is selected, the controller 290 searches for a video frameincluding the selected object among the video frames included in theimage displayed in operation 410 (S450). The controller 290 may searchfor the video frame using the content information database constructedin operation S400.

The controller 290 controls display of a thumbnail of the searched videoframe.

FIG. 13 is a view illustrating another exemplary embodiment of a screenon which thumbnails are displayed.

Referring to FIG. 13, the display 250 may display a screen 1300 inoperation S460. The screen 1300 may include an image region 1310 and athumbnail region 1320. The image region 1310 displays the imagedisplayed in operation S410 and the thumbnail region 1320 displaysthumbnails 1330, 1340 and 1350 of the video frames searched in operationS450. Additionally, the thumbnail region 1320 displays times 1335, 1345and 1355 when the thumbnails are displayed. The thumbnails 1330, 1340and 1350 may be thumbnails including the object selected in operationS440, which is included in the video frames.

The controller 290 checks whether or not a thumbnail is selected (S470).The thumbnail may be a thumbnail displayed in operation S460. Forexample, if the thumbnail 1330 of FIG. 13 is selected, the controller290 may confirm that the thumbnail is selected.

If the thumbnail is selected, the controller 290 controls display of thevideo frame indicated by the selected thumbnail (S480). For example, ifthe thumbnail 1330 of FIG. 13 is selected, the controller 290 controlsdisplay of a video frame associated with the thumbnail 1330. That is tosay, an image displayed on the image region 1310 is displayed from avideo frame associated with the thumbnail 1330.

In some embodiments, the controller 290 may search for the video frameincluding the object selected in operation S450 from among video framesof content included in the content information database. In this case,operations S350 to S390 may be implemented instead of operations S460 toS480.

FIG. 14 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with another embodiment ofthe present invention.

Referring to FIG. 14, the controller 290 constructs a contentinformation database (S500). Operation S500 may include theimplementation procedure of the method for constructing a contentinformation database of FIG. 14.

The controller 290 detects a user action of requesting retrieval (S505).

The controller 290 may control display of a GUI to input a search termin response to the detected user action (S510). The GUI may be displayedto overlay a broadcast screen, or may be displayed over the entirescreen. The display 250 may display the screen 800.

The controller 290 checks whether or not a search term is input (S515).In some embodiments, if the ‘OK’ button 825 illustrated in FIG. 8 ispressed, the controller 290 confirms that the search term displayed onthe search term input window 821 is input.

If the search term is input, the controller 290 searches for content inthe content information database constructed based on the input searchterm (S520). The controller 290 searches for content including a videoframe associated with the search term by comparing image informationincluded in the content information database with the input search term.That is to say, the controller 290 searches for a video frame havingimage information equal or similar to the input search term.

For example, if the input search term is “scene in IRIS where LEEBYEONGHEON, who wears a black garment, shoots with a sad expression”,the controller 290 may search for image information including thecollimator, black garment, sadness, LEE BYEONGHEON, shooting and IRISfrom the content information database, and may detect the video frame500 of FIG. 5 containing the searched image information. In addition, ifthe input search term is “scene in SECRET GARDEN where HYUN BIN, whowears black training clothes, is performing sit-ups together with lovelyHA GEEWON in a gymnasium”, the controller 290 may search for imageinformation including black/white stripes, love, HA GEE WON, HYUN BIN,gymnasium and SECRET GARDEN and may detect the video frame 600 of FIG. 6including the searched image information.

The controller 290 displays the search results (S525). The searchresults may be displayed to overlay a broadcast screen or may bedisplayed over the entire screen. The display 250 may display the screen900.

The controller 290 checks whether or not a content file is selected(S530). If specific content among content displayed as the searchresults is selected, the controller 290 may confirm that a content fileis selected. For example, if the ‘BBB’ 940 of FIG. 9 is selected, thecontroller 290 may confirm that a content file of the ‘BBB’ 940 isselected.

If the content file is selected, the controller 290 displays a thumbnailof the selected content file (S535). The thumbnails of the video framesassociated with the search term among the video frames included in theselected content file may be displayed. If the ‘AAA’ 930 of FIG. 9 isselected in operation S530, the display 250 may display a screen 1000 inoperation S535.

The controller 290 detects a user action of requesting dubbing (S540).In some embodiments, operation S540 may be implemented with operationsS505 to S535 in parallel.

The controller 290 switches a display mode to a dubbing mode in responseto the detected user action (S545).

The controller 290 checks whether or not a thumbnail is selected (S550).The thumbnail may be the thumbnail of the search results displayed inoperation S525 or may be the thumbnail displayed in operation S535. Forexample, the controller 290 may confirm that the thumbnail is selectedif the thumbnail 935 of FIG. 9 or the thumbnail 1040 of FIG. 10 isselected.

If the thumbnail is selected, the controller 290 controls display of avideo frame indicated by the selected thumbnail (S555). For example, ifthe thumbnail 935 of FIG. 9 is selected, the controller 290 controlsdisplay of a video frame associated with the thumbnail 935. That is tosay, the ‘AAA’ 930 may be displayed from the video frame associated withthe thumbnail 935. If the thumbnail 1040 of FIG. 10 is selected, thecontroller 290 controls display of a video frame associated with thethumbnail 1040. That is to say, the ‘AAA’ 930 may be displayed from thevideo frame associated with the thumbnail 1040.

The voice sensing unit 233 senses user voice and provides the sensedvoice to the controller 290 (S560).

The controller 290 multiplexes the voice sensed by the voice sensingunit 230 and the displayed image (S565). In some embodiments, thecontroller 290 may compress and multiplex the voice and the displayedimage.

The controller 290 stores the multiplexed voice and image (S570). Themultiplexed voice and image may be stored in the storage unit 280 andmay be stored in the external resources 112, 114, 120, 130 and 140.

FIG. 15 is a flowchart illustrating the implementation procedure of amethod for providing content in accordance with a further embodiment ofthe present invention.

Referring to FIG. 15, the controller 290 constructs a contentinformation database (S600). Operation S600 may include theimplementation procedure of the method for constructing a contentinformation database of FIG. 3.

The controller 290 controls display of content (S610). The content maybe stored in the storage unit 280, may be received from the externalresources 112, 114, 120, 130 and 140, or may be received by the tuner210.

The controller 290 detects a user action of requesting retrieval (S620).

The controller 290 controls display of an object selecting mark inresponse to the detected user action (S630). The object selecting markmay be used to select an object included in an image of contentdisplayed in operation S610. The object may include at least one ofhuman, animal and natural objects. The display 250 may display a screen1200 in operation S630.

The controller 290 checks whether or not an object is selected (S640).If one of the object selecting marks displayed in operation S640 isselected, the controller 290 confirms that an object indicated by theselected object selecting mark is selected.

If the object is selected, the controller 290 controls display of a GUIto select the voice tone of the selected object (S650).

FIG. 16 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to select the voice tone of an object is displayed.

Referring to FIG. 16, the display 250 may display a GUI 1600 inoperation S650. The GUI 1600 may be displayed to overlay a broadcastscreen, or may be displayed over the entire screen or on a partialscreen.

The GUI 1600 includes a radio button 1610 to select the voice tone of auser, a radio button 1620 to select the voice tone of a famousentertainer, an ‘OK’ button 1530 and a ‘Cancel’ button 1640.

FIG. 17 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to select an entertainer is displayed.

Referring to FIG. 17, if the radio button 1620 of FIG. 16 is selected,the controller 290 may control display of a GUI 1700. The GUI 1700includes an input window 1710, a list box 1720 and an ‘OK’ button 1730.The user may directly input the name of an entertainer, who has desiredvoice tone, into the input window 1710 and may select an entertainer whohas desired voice tone from the list box 1720. The user may completeselection of the entertainer by clicking the ‘OK’ button 1730.

The controller 290 detects a user action of requesting change in thevoice tone of the selected object (S660). In some embodiments, if the‘OK’ button 1630 is pressed in a state in which the radio button 1610 ofFIG. 16 is selected, the controller 290 detects a user action ofrequesting change of the voice tone of the selected object to the voicetone of a user. That is to say, the user action indicates the voice toneof a user.

In some embodiments, if the ‘OK’ button 1730 of FIG. 17 is pressed, thecontroller 290 detects a user action of requesting the voice tone of theselected object to the voice tone of the entertainer selected in FIG.17. That is to say, the user action indicates the voice tone of theentertainer selected in FIG. 17.

The controller 290 controls change from the voice tone of the object tothe voice tone indicated by the user action in response to the detecteduser action (S670). That is to say, in operation S670, the voice of theobject included in the content displayed in operation S610 is changed tothe voice tone indicated by the user action detected in operation S660.

In some embodiments, the controller 290 may store voice tone, which isindicated by the user action, as a voice tone setting value in thestorage unit 280. The voice tone setting value may be stored inassociation with an object identification value, which identifies anobject, and a content identification value which identifies contentdisplayed in operation S610. When the content displayed in operationS610 is again reproduced, the controller 290 may control change anddisplay of the voice tone of the object, which is indicated by theobject identification value associated with the voice tone settingvalue, according to the voice tone setting value.

In some embodiments, among audio data of content displayed in operationS610, the controller 290 may change audio data, which provides the voiceof the object selected in operation S640, to audio data which providesthe voice indicated by the user action.

FIG. 18 is a block diagram illustrating the configuration of acontroller in accordance with an exemplary embodiment of the presentinvention.

Referring to FIG. 18, the controller 290 may include a voice modulator1810, a voice encoder 1820 and a voice information detector 1830.

The voice modulator 1810 modulates a voice signal output from the audiodecoder 248 based on voice characteristics information. The voicecharacteristics information is information on components of voice. Thevoice characteristics information may include at least one ofinformation indicating Sound Pressure Level (SPL), tone frequencyinformation, tone color information, spectral flatness information andenvelope information. Additionally, the voice characteristicsinformation may include user's voice characteristics information andentertainer's voice characteristics information. The user's voicecharacteristics information is information on components of user's voiceand the entertainer's voice characteristics information is informationon components of entertainer's voice.

If a user action of selecting the radio button 1610 of the GUI 1600 isdetected, the voice modulator 1810 may access the user's voicecharacteristics information in the storage unit 280 and may modulate avoice signal based on the accessed user's voice characteristicsinformation. For example, the voice modulator 1810 may modulate a tonefrequency of the voice signal to a tone frequency indicated by tonefrequency information included in the user's voice characteristicsinformation, may modulate a tone color of the voice signal to a tonecolor indicated by tone color information included in the user's voicecharacteristics information, and may modulate a sound pressure level ofthe voice signal to a sound pressure level indicated by SPL informationincluded in the user's voice characteristics information.

Additionally, if a user action of requesting change to the voice tone ofa specific entertainer is detected, the voice modulator 1810 may accessentertainer's voice characteristics information on the specificentertainer in the storage unit 280 and may modulate a voice signalbased on the accessed entertainer's voice characteristics information.

The voice modulator 1810 may provide the modulated voice signal to thevoice output unit 260 and may provide the modulated voice signal to theaudio encoder 1820.

The audio encoder 1820 may compress the voice signal output from thevoice modulator 1810 and may store the compressed voice signal in thestorage unit 280.

The voice information detector 1830 receives the user's voice detectedby the voice sensing unit 233 and detects components of the receiveduser's voice. That is to say, the voice information detector 1830 maydetect at least one of sound pressure level, tone frequency, tone color,spectral flatness and envelope of the user's voice. The voiceinformation detector 1830 may produce user's voice characteristicsinformation indicated by the detected voice component and may store theproduced user's voice characteristics information in the storage unit280.

FIG. 19 is a view illustrating an exemplary embodiment of a screen onwhich a GUI to set a voice modulation level is displayed.

Referring to FIG. 19, the display 250 may display a GUI 1900 to set avoice modulation level. The controller 290 may detect a user action ofrequesting setting of the voice modulation level and may control displayof the GUI 1900 in response to the detected user action.

The GUI 1900 includes an indicator 1910 to adjust an SPL, an indicator1920 to adjust a tone frequency level, an indicator 1930 to adjust atone color level, an indicator 1940 to adjust a spectral flatness level,and an indicator 1950 to adjust an envelope level. The GUI 1900 includesinput windows 1915, 1925, 1935, 1945 and 1955 to display the respectivelevels indicated by the indicators 1910, 1920, 1930, 1940 and 1950 andfurther includes an ‘OK’ button 1970 and a ‘Cancel’ button 1980.

When the GUI 1900 is initially displayed, the indicators 1910, 1920,1930, 1940 and 1950 may be located at positions corresponding to levelsindicated by SPL, musical interval, tone color, spectral flatness andenvelope information included in the voice characteristics information.The voice characteristics information may be user's voicecharacteristics information or entertainer's voice characteristicsinformation. If the user action of selecting the radio button 1610 ofFIG. 16 is selected in operation S660, the voice characteristicsinformation may be user's voice characteristics information. If the useraction of selecting a specific entertainer via the GUI 1700 of FIG. 17is detected, the voice characteristics information may be voicecharacteristics information of the selected entertainer.

The user may perform a user action of indicating adjustment of acorresponding voice component level by dragging one of the indicators1910, 1920, 1930, 1940 and 1950. The controller 290 may detect the useraction and may change a corresponding voice component level based on thelevel indicated by the indicator that is moved by the user action. Theindicators 1910, 1920, 1930, 1940 and 1950 are moved by a draggedlength. For example, if the user drags the indicator 1910 to a positioncorresponding to the level of 35, the indicator 1910 is moved to theposition corresponding to the level of 35. The controller 290 changes anSPL level based on the level of 35 indicated by the moved indicator1910.

The GUI 1900 may be displayed during display of content. In this case,if the user drags one of the indicators 1910, 1920, 1930, 1940 and 1950,the controller 290 may change a voice component level associated withthe dragged indicator based on a level indicated by the draggedindicator and the voice of content may be modulated to the changed voicecomponent level. For example, if the user drags the indicator 1920 to aposition corresponding to the level of 65, the controller 290 changes atone frequency level based on the level of 65 and the tone frequency ofcontent that is being reproduced may be modulated the changed tonefrequency level.

If the user performs a user action of pressing the ‘OK’ button 1970, theSPL information, tone frequency information, tone color information,spectral flatness information and envelope information included in thevoice characteristics information are changed in level based on therespective levels displayed on the input windows 1915, 1925, 1935, 1945and 1955 and the GUI 1900 disappears from the screen. If the userperforms a user action of pressing the ‘Cancel’ button 1980, the GUI1900 disappears from the screen without change of the voicecharacteristics information.

The present invention may be implemented as code that can be written ona computer-readable recording medium and can thus be read by a computer.The computer-readable recording medium includes all types of recordingdevices in which data is stored in a computer-readable manner. Examplesof the computer-readable recording medium include a ROM, a RAM, aCD-ROM, a magnetic tape, a floppy disc, an optical data storage, and acarrier wave (e.g., data transmission through the Internet). Thecomputer-readable recording medium can be distributed over a pluralityof computer devices connected through a network so thatcomputer-readable code is written thereto and executed therefrom in adecentralized manner.

As is apparent from the above description, through provision of adisplay device and a method for providing content using the displaydevice in accordance with the present invention, a user can search for avideo frame and audio contained in content. More particularly, the usercan search for a video frame corresponding to a scene where a particularcharacter comes along without directly seeing the video frame and canalso search for a video frame and audio of content that is stored inanother device. Moreover, it is possible to search for a desired videoframe and audio at a time rather than performing retrieval on a perdevice basis. Since the searched results may be provided in the form ofthumbnails and a video frame and audio associated with the selectedthumbnail may be directly displayed, the user can easily select and editthe searched video frame and audio.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A method for providing content using a displaydevice, the method comprising: constructing a content informationdatabase; receiving a user input; searching for at least one contentincluding a video frame associated with a search term included in thereceived user input in the content information database; and displayinga list of the searched content, wherein constructing the contentinformation database includes accessing content, extracting a videoframe from the accessed content, checking whether or not the extractedvideo frame satisfies requirements of a key frame, the requirements ofthe key frame including whether the extracted video frame corresponds toa scene change in the accessed content, selecting the video frame as thekey frame if the video frame satisfies the requirements of the keyframe, and producing image information associated with the selectedvideo frame.
 2. The method according to claim 1, further comprisingediting content included in the list of the searched content.
 3. Themethod according to claim 2, wherein the editing includes at least oneof: replacing a video frame of the content with another video frame;dubbing voice to the content; varying a voice level of at least a partof audio data included in the content; or replacing at least a part ofaudio data included in the content with previously stored audio data. 4.The method according to claim 1, wherein the content is stored in atleast one of a global resource or a local resource.
 5. The methodaccording to claim 1, wherein the displayed list includes a thumbnailcorresponding to the video frame.
 6. The method according to claim 5,further comprising: detecting a selection of the thumbnail; anddisplaying a video frame associated with the selected thumbnail.
 7. Themethod according to claim 1, further comprising: detecting a selectionof content included in the list; and displaying a thumbnail of a videoframe associated with the search term among video frames included in thecontent.
 8. The method according to claim 1, wherein the searching forthe content includes searching for the video frame associated with thesearch term using the content information database including imageinformation with respect to the video frame included in the content. 9.The method according to claim 1, wherein the producing image informationincludes producing image information using information included in avisual descriptor of the content.
 10. The method according to claim 1,wherein the content information database further includes positioninformation of the video frame and information to associate the positioninformation of the video frame with the image information.
 11. Themethod according to claim 1, wherein the image information includes atleast one of characteristics information on the video frame, subjectiveinformation on the video frame or expository information on the videoframe.
 12. The method according to claim 1, wherein producing the imageinformation includes at least one of: analyzing objective information onthe selected video frame, analyzing subjective information on theselected video frame, or analyzing expository information on theselected video frame.
 13. The method according to claim 1, whereinconstructing the content information database further includes storingthe produced image information to be indexed based on at least one ofthe image information.
 14. The method of claim 1, wherein the extractedvideo frame is determined to be a key frame when a change rate in theextracted video frame between a prescribed video frame and a previousvideo frame is greater than or equal to 50%.
 15. The method of claim 1,wherein at least one image in the content is configured to beselectable, and the user input is a selection of the at least one imagein the displayed content to search for key frames associated with theselected image.
 16. The method of claim 1, wherein the controllerreceives a selection of a content displayed in the list, displays avideo frame corresponding to the selected content, selects a prescribedvoice for audio in the selected video frame, and changes a voice in theselected content to the selected voice.
 17. A display device comprising:a controller to receive a search term and search for at least onecontent including a video frame associated with the received search termin the content information database; and a display to display a list ofthe searched content, wherein the controller is configured to constructthe content information database by accessing content, extract a videoframe from the accessed content, check whether or not the extractedvideo frame satisfies requirements of a key frame, select the videoframe as the key frame when the video frame satisfies the requirementsof the key frame, and produce image information associated with theselected video frame, and wherein the controller is configured toreceive a selection of a content displayed in the list, display a videoframe corresponding to the selected content, select a prescribed voicefor audio in the selected video frame, and change a voice in theselected content to the selected voice.
 18. The display device accordingto claim 17, wherein the controller is configured to edit contentincluded in the list of the searched content.
 19. The display deviceaccording to claim 17, wherein the controller is further configured tostore the produced image information to be indexed based on at least oneof the image information.